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ABSTRACT 

Of the various systems developed for student 
evaluation of course and inst3cuctorr the Illinois Course Evaluation 
Questionnaire (CEQ) has perhaps the most extensive reliability and 
validity data to support it as well as the most extensive norm data 
base. The CEQ is used to collect student attitudes towards a course 
and instructor and its purpose is to enable faculty members to 
collect evaluative information about their teaching. The CEQ can also 
be used to provide feedback to administrators if it is couched in a 
total instructional evaluation scheme that may consist of peer 
evaluation, supervisor evaluation, classroom visitation, course 
material evaluation, future student success and achievement data. 
(Author/HS) 
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In the past few years as a result of the 1970 student strikes and the 
emphasis on accountabllityy course and Instructor evaluation has been placed 
in the spotlight* In an attei!q>t to build a total instructional evaluation 
system^ a great deal of emphasis has been placed on student evaluations of 
course and instructor. In order for student evaluations to be considered 
an Integral part of a total instructional evaluation system, they must be 
both reliable and valid* 

Of the various* systems developed for student evaluation of course and 
instructor* the Illinois Course Evaluation Questionnaire (CEQ) has perhaps 
the most extensive reliability and validity data to support it as well as 
the most extensive norm data base* tlorm data have been collected continu** 
ously since 1966 at the University of Illinois » Urbana-Champaign campus* 
The CEQ is used to collect student attitudes towards a course and instructor 
and its purpose is to enable faculty members to collect evaluative informa- 
tion about their teaching. Once the instructor has used the CEQ and submitted 
the forms for analysis » two copies of the results are returned only to the 
\ instructor* However, pooled results for entire courses consisting of many 

^ sections nay also be obtained wJ.th instructor identification omitted* As 
\ 

> — 

^ ^Part of a symposium presentation entitled ''A Plan for the Conqirehensive 
^ Evaluation of College Teaching" at the American Educational Research 
Association Convention in Mew Orleans, Louisiana, February 27, 1973. 



the iitimber of measures on each course is Increased » it becomes possible to 
obtain a relatively stable Indication of the difference between courses* 
This aids In the Interpretation of the actual differences between an obtained 
section score for a particular instructor and the average s» ores for all the 
sections represented lii that course* 

The analysis of itc^ni Intor-relatloaships and the subscore Inter-velatlon- 
ships Indicated that no one element, related to a course, disproportionately 
Influenced the students* evaluation of the course (Spencer & Aleamoni, 1969) • 
It appears that there is a "general course attitude" cultivated by the student 
as he is esqposed to previous student's coiuments, the instructor, the textbuok, 
the course, etc*, and this is the framework from which he responds when answer- 
ing the CEQ iteos. 

It would seem, on the basis of three validity studies (Stalllngs & Spencer, 
1967; Swanson & Slsson, 1971; Aleanoni & Yimer, 19/2), the face validity of 
the CEQ, and its high reliability, that extremely low scores on a particular 
subscore should indicate problem areas in an instructor's teaching procedure* 
Tfhereas, stable high scores should point to an effective instructional program 
as viewed by students. All available validating evidence (both published and 
unpublished studies) to date, indlc^ates that the CEQ does indeed identify 
courses that are considered to be excellent or poor* 

After using the CEQ, the instructor receives results (see Appendix A) 
which allow him to compare his course item means to institutional course item 
means (via deciles) and his course subscale means to norm subscaJ.e means 
categorized by (a) rank of instructor, (b) level of course, (c) institution, 
(d) college, and (e) all institutions that have used the CEQ throughout the 
United States* The subscale results allow the Instructor to obtain an 
indication of major areas of strengths and weaknesses in the course. Once 
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the areas of V7eakness have been identified by the subscales, then looking 
at the item results helps to focus on the more specific problem areas. The 
CEQ items are not completely diagnostic but do serve to elicit diagnostic 
responses from the instructor teaching the course. It provides a means 
whereby soma evaluation of the teaching process can ocjiiur; other means can 
be arranged and are available such as asking more diagnostic questions in 
the optional item section available on the CEQ form, or having peers sit in 
on actual class sessions, etc* It is important to recognize, hot^ever, that 
student opinions are in existenca and do affect learning — and they do provide 
a source of quite reliable and valid data relative to the effectiveness of 
Instruction (Costin, Greenough & Ilenges, 1971)* 

In order to provide instructors with items that may be more relevant 
or diagnostic for their particular courses, a catalog of items was generated 
by the Measurement and Research Division of the Office of Instructional 
Resources at the University of Illinois^ Urbana-Champaign campus* The items 
were gathered from all existing sources such as institutional, national, de~ 
partmental, and individual instructor questionnaires* They were then restated 
so that the response categories of strongly agree (SA) , agree (A) , disagree (D) , 
and strongly disagree (SD) vjould apply* This then made it possible for those 
items to be used in the "Optional Item" section of the CEQ (see Appendix B). 

This collection of some 270 items was divided into 19 categories consisting 
of: (a) Instructor contribution, (b) attitude toward students, (c) student 
outcomes* (d) relevance of course, (e) use of class time, (f) organization and 
presentation, (g) clarity of presentation, (h) instructor characteristics, 
(i) interest of presentation, (j) expectations and objectives, (k) behavioral 
indications of course attitude »- (1) general attitude toward instructor, (m) 
speed and depth of coverage, (n) out^f -class, (o) examinations, (p) -^.sual 
aids, (q) grading, (r) assignments, and.(s) laboratory and recitation. 



The response to the availability of the catalog of optional items was 
gratifying in that it was not finished until December 12, 1972, less than 
four weeks before the end of the fall semester. Of 1414 course sections 
using the CEQ during fall semester 1972, approximately 313 made use of the 
optional item section • 

After the instructor has decided to use the CEQ and/or any optional 
items of his choice, it is then up to him to decide what to do with the 
data. If he feels that the interpretation manual (Aleamoni, 1972) and 
abbreviated interpretation sheets are not sufficient to help him identify 
areas that may need Improvement in the course, he can then arrange for a 
conference with one of the members of the Measurement and Research Division 
staff. Such a conference would begin with a close scrutiny of the CEQ sub- 
scale results to see if any problems existed based on the norm data available* 
If a problem area was identified (such as Method of Instruction) then a close 
look at the items making up that subscale would be in order. If, in the 
discussion with the instructor the source of difficulty is identified, then 
the discussion would shift to possible ways of trying to resolve the 
difficulty. If, on the other hand, the source of difficulty cannot be 
identified tising the existing items and the instructor's recall, then pro- 
cedures (such as the use of optional items that are much more diagnostic) 
would be explored to be able to Identify the specific problem. 

It has been through a process such as this that instructors have been 
able to use student evaluations to identify instructional problems and then 
rectify them# Obviously, the success or failure of such a venture rests 
solely with the i istructor and his willingness to both gather and use the 
data provided him. 



The CEQ can also be used to provide feedback to administrators (deans, 
department heads, etc.) if it is couched in a total instructional evaluation 
scheme which may consist of peer evaluation, supervisor evaluation, class- 
room visitation, course material evaluation, future student success and 
achievement data, etc. Student course and instructor evaluation data should 
not be lised alone in evaluating instructional effectiveness in rank, pay, and 
tenure decisions as it is not completely diagnostic of all elements in the 
teaching or instruction domain. Tlie actual weight applied to student evalua- 
tions by administrators varies from 0 to 100% depending upon the department, 
college and institution. IJhat weight student evaluations should ideally 
carry is contingent upon the number and quality of other elements used in 
the instructional evaluation scheme. 
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